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CHAPTER  1 


INTRODUCTION 

The  management  of  computer  data/information  proces¬ 
sing  resources  is  undergoing  a  revolution  in  the  1980s.  The 
emphasis  on  computer  hardware  and  software  is  shifting  toward 
a  focus  on  information  management,  stressing  the  quality  and 
the  value  of  computer  output  rather  than  the  quantity  (25:3). 
The  Federal  Government  and  the  Department  of  the  Air  Force, 
realizing  the  burden  of  excess  paperwork,  records  management, 
and  information  sharing  have  initiated  steps  to  improve  the 
reliability  and  consistency  of  information  used  in  decision¬ 
making  and  achieving  goals.  One  product  of  the  initiatives 
is  the  conceptualization  of  an  Air  Staff  Information  Manage¬ 
ment  System  (ASIMS)  within  the  Department  of  the  Air  Force 
to  serve  the  Air  Staff  and  the  Office  of  the  Secretary  of  the 
Air  Force  (OSAF) .  The  growth  and  development  of  ASIMS  can 
benefit  from  the  evolution  of  similar  information  management 
systems  in  other  organizations. 

The  successful  implementation  of  previous  information 
management  systems  in  corporations  and  non-profit  organiza¬ 
tions  reflects  a  similar  growth  pattern  in  each  organization 
(15:116).  Experience  has  indicated  that  the  organization  and 
its  members  must  develop  and  grow  together  to  provide  the 
most  successful  information  management  system.  Until 


organizational  members  understand  the  capabilities  of  the 
computer  systems,  management  is  concerned  with  managing  the 
computer  and  its  many  potential  uses.  Once  the  successful 
management  of  the  computer  resources  is  accomplished,  empha¬ 
sis  turns  to  the  management  of  data/information  resources. 

This  transition  is  unique  to  every  organization,  but  tends 
to  follow  an  established  cycle  if  the  growth  of  the  informa¬ 
tion  management  system  is  successful  and  ongoing  (15:116). 

Throughout  this  research  effort  the  terms  data  and 
information  may  be  used  together  or  separately.  There  are  a 
variety  of  definitions  that  attempt  to  describe  the  relation¬ 
ship  between  data  and  information. 

Data  can  be  thought  of  as  comprising  any  set  of 
characters  that  is  accepted  as  input  to  an  informa¬ 
tion  system  and  is  stored  and  processed.  Informa¬ 
tion  refers  to  output  of  data  processing  that  is 
organized  and  meaningful  to  the  person  who  receives 
it  [5:11]. 

Others  refer  to  data  as  " .  .  .  unrestricted,  unevaluated  facts 
having  little  or  no  meaning.  It  is  only  when  data  are  applied 
to  a  specific  problem  (evaluated)  that  they  become  information 
[19:143]."  Thus  information  is  data  evaluated  for  a  particular 
problem,  for  a  specific  individual,  at  a  certain  time.  There¬ 
fore,  what  may  constitute  information  for  one  individual  at  a 
specific  instance  may  not  do  so  for  another  or  even  the  same 
person  at  a  different  time  (19:143).  Often  data  and  informa¬ 
tion  are  closely  related;  for  this  research  the  terms  are 
used  interchangeably. 


Government  and  Air  Force  Initiatives 
in  Information  Management 

The  need  for  reliable,  timely,  and  consistent  informa¬ 
tion  at  all  levels  of  government  operations  is  essential  in 
achieving  federal  goals  (28:1).  The  information  gathering 
process  used  by  many  federal  agencies  is  inadequate  for  the 
demands  placed  on  them.  Estimates  indicate  that  the  public 
spends  one  billion  hours  each  year  completing  forms  generated 
by  such  agencies  as  the  Internal  Revenue  Service  and  the 
Social  Security  Administration.  Often  different  agencies 
need  identical  information  from  the  public,  but  are  unaware 
that  another  department  already  has  the  information  on  file. 
This  mismanagement  of  data/information  resources  accounts 
for  part  of  the  $5  billion  annual  government  computer  work 
budget.  Less  than  optimal  use  of  information  within  the 
Department  of  Defense  (DoD)  is  also  gaining  attention.  At 
over  $2  billion  in  1980,  the  DoD  computer  use  budget  exceeds 
that  of  the  largest  American  firms  (11:54-56). 

Concern  with  computer  costs  and  growing  demands  on  the 
public  in  .the  form  of  information  reporting  burdens  and 
record  keeping  requirements  resulted  in  the  creation  of  the 
Commission  on  Federal  Paperwork  on  27  December  1974  (28:69), 
and  later  the  Federal  Data  Processing  Reorganization  Project 
(FDPRP)  by  the  Carter  Administration  (11:54).  These  two 
government  initiatives  revealed  a  great  deal  about  the 
federal  government's  data  gathering  and  information  processing 
systems.  These  programs  provided  the  impetus  for  the 
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continued  attention  given  to  the  government's  methods  of 
managing  information  over  the  past  six  years.  One  outcome  of 
the  two  programs  is  the  conceptualization  of  an  Air  Staff 
Information  Management  System,  which  will  incorporate  many  of 
the  recommendations  and  new  concepts  of  the  Paperwork  Commis¬ 
sion  and  the  FDPRP.  The  overall  objective  of  ASIMS  is  to 
provide  timely,  accurate,  and  consistent  information  for  Air 
Staff  and  Office  of  the  Secretary  of  the  Air  Force  problem 
solving  and  decision  making  (7:p.  1.1). 

The  FDPRP  and  the  Commission  on  Federal  Paperwork  found 
many  significant  deficiencies  in  government  information  usage 
that  ASIMS  hopes  to  remedy  at  the  Headquarters  Air  Force 
level.  The  FDPRP  report  disclosed  that  while  the  government 
developed  the  first  successful,  large-scale  data  processing 
installation  in  the  early  50s,  and  pioneered  the  use  of  pro¬ 
gram  languages  in  the  60s,  the  70s  saw  the  government  equip¬ 
ment  inventory  generally  become  highly  obsolescent,  lagging 
behind  comparable  installations  in  private  industry.  The  gap 
has  grown  so  that  the  average  age  of  all  computer  systems  in 
the  federal  government  is  over  seven  years,  while  dramatic 
improvements  in  computer  technology  are  occurring  each  year. 
The  Federal  Data  Processing  Reorganization  Project  also 
found  that  the  federal  government  is  mismanaging  its  informa¬ 
tion  technology  resources  and  has  not  developed  a  plan  for 
examining  future  opportunities  in  information  use.  In  addi¬ 
tion,  the  FDPRP  report  claims  that  the  military  is  opera¬ 
tionally  vulnerable  as  a  result  of  obsolete  equipment  and 


underdeveloped  personnel  (11:54-56). 

The  Federal  Paperwork  Commission  also  exposed  similar 
tendencies  to  mismanage  information  in  other  government 
agencies.  The  Commission  found  that  needed  information  is 
often  not  being  collected,  is  not  timely,  or  is  not  reliable; 
which  limits  the  success  of  federal  programs.  The  Commission's 
report,  issued  in  September  1977,  advocated  the  managing  of 
information  as  a  resource,  so  that  data  will  be  planned, 
budgeted,  controlled,  and  evaluated  adequately  (29:40). 

The  Commission  on  Federal  Paperwork  is  first  credited 
with  introducing  the  term  Information  Resources  Management 
(IRM)  as  follows: 

The  principles  behind  IRM  encompass  the  idea  that 
all  media  and  technologies  can  be  combined  in  a  way 
that  will  optimize  the  productivity  of  the  individuals 
in  the  organization,  thereby  optimizing  the  total 
information  handling  activities  [13:24]. 

The  studies  done  by  the  FDPRP  and  the  Paperwork 
Commission  laid  the  groundwork  for  the  passage  of  Public  Law 
96-511,  the  Paperwork  Reduction  Act  of  1980,  signed  by  the 
President  on  11  December  1980.  The  law  first  establishes  an 
Office  of  Information  and  Regulatory  Affairs  under  the  Office 
of  Management  and  Budget  (0MB)  with  responsibility  for  all 
information  management  activities  including  information  col¬ 
lection,  statistical  activities,  records  management,  privacy 
of  records,  interagency  sharing  of  information,  automatic  data 
processing,  and  telecommunications  (11:56;  43:32).  The  law 
also  creates  the  Federal  Information  Locator  System  (FILS) 
as  a  directory  of  government  information  resources,  which  can 
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be  consulted  by  agencies  before  gathering  information  to  in¬ 
sure  the  data  has  not  already  been  collected  (30:23-26). 

Each  federal  agency  is  required  to  designate  a  senior  officer, 
who  reports  directly  to  the  agency  head,  to  carry  out  the 
responsibilities  of  information  resources  management, 

.  .  .  including  planning,  budgeting,  organizing, 
training,  promoting,  controlling,  and  other  mana¬ 
gerial  activities  involving  the  collection,  use, 
and  dissemination  of  information  [43:32]. 

In  carrying  out  the  directives  of  the  Paperwork  Reduc¬ 
tion  Act,  the  Office  of  Information  and  Regulatory  Affairs 
has  tasked  the  Department  of  Defense  and  the  Department  of 
the  Air  Force  to  comply  with  the  guidelines  established  by 
Public  Law  96-511.  Headquarters  Air  Force,  through  an  Ad  Hoc 
Planning  Group  and  an  Information  Management  Agency,  has 
begun  planning  the  future  Air  Force  strategy  for  overall 
information  management.  The  Air  Force  feels  that  the  follow¬ 
ing  goals,  if  pursued  as  long-range  objectives,  will  improve 
the  management  of  and  use  of  information: 

1.  Treat  data/ information  as  a  key  organizational 
resource , 

2.  Identify  the  cost  and  burden  of  information 
requirements , 

3.  Improve  the  ability  to  answer  questions  and 
provide  information  for  decision  making, 

4.  Reduce  the  manhours  and  dollars  required  to 
process,  manage,  and  use  information, 

5.  Improve  productivity,  and 

6.  Get  personnel  thinking  more  about  management 
of  information  (1:9-10). 

The  guidance  originating  with  the  President  through 


OMB  and  the  Department  of  the  Air  Force  has,  in  part,  been 
responsible  for  the  conceptualization  of  ASIMS.  In  addition 
the  expanded  information  requirements  of  the  Air  Staff  have 
also  generated  an  internal  desire  for  better  information 
management.  The  most  significant  Air  Staff  problems  are  sub 
stantial  delays  in  responding  to  Congressional  inquiries, 
conflicting  answers  often  given  to  Congress,  information 
saturation,  and  management  frustration  (20:4).  The  problem 
is  so  significant  that  various  headquarters  offices  have 
begun  initiatives  to  develop  Deputy  Chief  of  Staff  or  Direc¬ 
torate  level  Information  Management  Systems  (7:1). 

The  combination  of  outside  emphasis  and  the  internal 
initiatives  to  improve  the  Air  Staff  management  of  informa¬ 
tion 

.  .  .  have  generated  both  the  opportunity  and  obliga¬ 
tion  to  provide  sorely  needed  management  information 
support  while  achieving  real  efficiencies  and  econo¬ 
mies  in  information  processing  [7:1]. 

ASIMS  is  the  Air  Staff's  plan  for  integrating  all  efforts  to 

manage  information  as  a  key  organizational  resource.  A 

Project  Management  Office  (PMO)  has  been  established  on  the 

Assistant  Vice  Chief's  immediate  staff  for  developing  and 

executing  the  plan  for  implementation  of  ASIMS  to  serve  both 

the  Office  of  the  Secretary  of  the  Air  Force  (OSAF)  and  the 

Air  Staff  (7:1) . 

Statement  of  the  Problem 

The  Air  Staff  Information  Management  System  is  needed 
for  the  Air  Force  to  compete  with  other  services  to  enhance 


mission  accomplishment.  ASIMS  will  ameliorate  several  prob¬ 
lems  for  the  OSAF  and  the  Air  Staff  when  fully  and  properly 
implemented.  The  major  problems  include  increasing  response 
time  to  complete  action  items,  providing  conflicting  informa¬ 
tion  to  Congress,  and  acquiring  too  much  information.  By 
implementing  ASIMS  the  Air  Staff  hopes  to  achieve  higher 
staff  productivity,  enhanced  quality  of  work,  improve  timeli¬ 
ness,  and  a  reduction  in  labor  intensity.  The  additional 
benefits  of  ASIMS  include  cost  avoidance  through  savings  from 
more  efficient  management  and  increased  efficiency  in  admini¬ 
strative  support  (20:4,  29). 

The  ASIMS  Project  Management  Office  has  established 
the  goals  of  a  mature  program  as: 

1.  Assure  timely,  accurate,  and  consistent  informa¬ 
tion  is  available  for  Air  Staff  and  OSAF  problem 
solving  and  decision  making. 

2.  Incorporate  the  flexibility  required  to  have  the 
information  system  anticipate  and  survive  organi¬ 
zational  and  management  changes. 

3.  Be  responsive  tc  changing  information  needs  in 
terms  of  data  content,  currency,  format,  media, 
and  distribution. 

4.  Minimize  unnecessary  duplication. 

5.  Incorporate  greater  sharing  of  information 
through  the  employment  of  data  standards,  a  data 
dictionary,  data  base  management  techniques,  and 
telecommunications . 

6.  Facilitate  interoperability  among  information 
systems . 

7.  Enhance  the  efficiency  and  economy  of  processing 
information. 

8.  Enhance  the  productivity  of  personnel  who  handle 
information. 


9.  Treat  information  as  a  key  organizational 
resource  (7  :p.  1.1). 

For  an  organization  to  meet  and  maintain  the  desired 
goals  of  ASIMS  it  must  have  an  organizational  design  that 
will  allow  for  effectiveness  and  efficiency.  Although  there 
is  no  best  way  to  organize,  different  organizational  designs 
provide  for  different  levels  of  innovation  and  control  (8:2; 
2:557).  In  addition,  as  Richard  L.  Nolan  has  stressed  in  his 
model  portraying  the  growth  of  the  data/information  processing 
organization,  the  properly  timed  management  emphasis  is  essen¬ 
tial  to  the  successful  evolution  of  the  information  management 
organization  (15:116).  The  goals  of  ASIMS  and  the  need  for 
management  direction  and  emphasis  reveal  one  problem  in  the 
development  of  ASIMS.  At  this  time  there  is  not  an  existing 
organizational  design  to  foster  innovation  and  provide  con¬ 
trol  for  the  proposed  Air  Staff  Information  Management  System. 

Objectives  of  the  Research 

This  research  effort  concentrated  on  three  primary 
objectives.  Initially,  using  Richard  Nolan's  model  on  the 
evolutionary  stages  of  data/ information  management  growth, 
criteria  were  specified  to  evaluate  a  nonprofit  militaw 
organization.  Next,  the  applicable  criteria  were  used  to 
measure  the  overall  Air  Staff  and  its  major  divisions  with 
respect  to  Nolan's  six  stages  of  data/information  processing 
growth.  The  final  objective  was  to  analyze  the  results  of 
the  evaluations  of  the  Air  Staff  as  a  whole  and  its  major 
divisions  to  provide  a  basis  for  the  specific  organizational 


design  to  be  implemented  in  preparation  for  the  adoption  of 
ASIMS.  Guidelines  for  the  appropriate  innovation  and  control 
characteristics  are  recommended  for  each  subsequent  stage  of 
growth. 

Scope 

The  establishment  of  ASIMS  is  unique  to  the  Air  Staff, 
and  the  specific  results  of  this  research  may  not  be  appli¬ 
cable  to  other  organizations.  The  data  gathered  are  from  the 
major  organizational  units  within  the  Air  Staff  and  the  OSAF. 

Although  this  research  centers  on  gathering  data  to 
determine  the  appropriate  organizational  design  of  ASIMS, 
several  areas  of  this  project  may  be  relevant  to  other  studie 
Specifically,  a  better  understanding  of  the  stages  of  growth 
in  a  data/information  processing  organization  as  it  relates 
to  Nolan's  stage  theory  can  be  gained  from  the  research.  In 


addition,  the  application  of  criteria  to  the  six  stages  of 
growth  for  a  military  organization  may  be  helpful  in  conduct¬ 
ing  future  research  in  a  similar  environment. 


CHAPTER  2 


DATA  PROCESSING  GROWTH  MODELS 

Many  organizations  have  experienced  a  rapid  growth  in 
data  processing  budgets,  but  have  not  recognized  a  similar 
growth  in  the  productivity  of  these  systems.  The  annual 
data/information  processing  budgets  are  exceeding  growth  rates 
of  30  percent.  This  increase  per  year  is  more  than  the  total 
size  of  the  budgets  four  to  five  years  ago  (15:116). 

The  most  recent  literature  concerning  the  data  proces¬ 
sing  function  in  organizations  contends  that  data  processing 
evolves  through  distinct  stages  of  learning  and  growth.  The 
growth  pattern  (reflected,  in  data  processing  costs)  follows 
that  of  an  S-shaped  curve.  This  curve  has  been  used  by  Arnold 
Toynbee  to  explain  the  histories  of  societies,  and  by  others 
to  explain  the  success  pattern  or  organizations,  product 
development,  market  development,  as  well  as  life  cycles  of 
technologies  (12:457;  24:46). 

The  following  review  discusses  the  stage  theories  that 
have  evolved  with  respect  to  the  growth  of  the  data  processing 
function.  Cyrus  F.  Gibson  and  Richard  L.  Nolan  first  identi¬ 
fied  four  stages  of  data  processing  growth.  Others  including 
Paul  A.  Strassman  and  Frederic  G.  Withington  were  to  comment  on 
and  critique  the  four-stage  theory,  which  influenced  Nolan  in 
expanding  his  four-stage  concept  to  a  six- stage  growth  pattern 
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that  more  accurately  reflects  present  data  processing  growth 
in  organizations. 

The  Four-Stage  Growth  Theory 

In  1973  Richard  Nolan,  a  former  associate  professor  of 
business  administration  at  the  Harvard  Business  School,  dis¬ 
covered  that  the  data  processing  budgets  for  a  number  of 
companies,  when  plotted  over  time,  forms  an  S- shaped  curve 
that  he  referred  to  as  the  Data  Processing  Learning  Curve 
(9:77).  The  changes  in  slope  of  this  curve  correspond  to  the 
significant  events  in  the  life  of  the  data  processing  function 
that  identify  shifts  in  the  way  the  computer  resource  is 
managed  and  used.  There  are  three  points  where  the  S-shaped 
curve  turns  that  depicts  the  natural  break  between  the  four 
stages  that  Nolan  and  Gibson  first  identified.  The  four 
stages  depicted  in  Figure  1  --  Initiation,  Expansion,  Formali¬ 
zation,  and  Maturity  --  are  defined  by  the  inflection  points 
on  the  data  processing  learning  curve  (9:78). 

As  the  data  processing  department  matures,  the  organi¬ 
zation  evolves  from  one  stage  to  the  next.  In  Nolan's  four- 
stage  hypothesis,  the  growth  takes  place  in  three  primary 
areas:  1)  the  portfolio  of  computer  applications  for  each 

stage;  2)  the  personnel  specialization  required  of  the  workers 
and  3)  the  management  techniques  customarily  applied  in  each 
of  the  four  stages.  Figure  2  describes  the  three  areas  of 
growth  and  further  details  the  evolution  as  an  organization 
moves  from  stage  1  to  stage  4.  For  example,  in  stage  1  with 
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Fig  1.  Data  Processing  Learning  Curve 

(24:47) 

computer  applications,  the  introduction  of  data  processing 
equipment  to  reduce  costs  where  manual  accounting  operations 
take  place,  will  result  in  lower  expenses  for  maintaining 
payroll,  cash  flow,  and  billing  accounts. 

In  their  article,  Gibson  and  Nolan  warned  that  there 
may  be  more  S  curves  as  new  technologies  emerge,  and  as  organi 
zations  become  more  aggressive  in  using  data  processing  tech¬ 
niques  and  more  sophisticated  in  systems  analysis  (9:77). 

Two  other  information  system  specialists  made  contributions 
on  the  evolution  of  data  processing  that  were  to  influence 
Nolan  in  his  later  articles.  Paul  Strassman,  of  Xerox  Corpora 
tion,  first  pointed  out  that  inflation  can  influence  the 
S- shaped  curves  that  represent  the  data  processing  costs  of 
an  organization  over  time.  Inflation  guarantees  that  labor 
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Fig  2.  Three  Areas  of  Growth  (24:47) 
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costs,  which  may  represent  50  to  70  percent  of  the  budget, 
will  increase  with  time.  Strassman  contends  cost/benefit 
ratios,  or  a  similar  method  of  determining  project  profitabil¬ 
ity,  provides  the  best  indicator  of  the  desirability  of  new 
data  processing  projects  (24:48). 

Another  data  processing  consultant  was  to  influence 
Nolan  by  explaining  the  evolution  of  data/information  proces¬ 
sing  as  an  ongoing  process.  Frederic  Withington  proposed  five 
generations  of  computers  that  reflect  the  evolutionary  process 
of  computers  as  being  essentially  technology-driven.  Withing¬ 
ton  states  that  the  current  technology  will  drive  the  new 
applications  to  be  accepted  and  the  type  of  organizational 
structure  adopted  for  managing  the  data  processing  system 
(42:100).  Table  I  depicts  Withington's  five  generations  of 
computers  and  how  the  hardware,  computer  functions,  and 
organization  will  evolve  over  time. 


The  Six-Stage  Growth  Theory 

Nolan  continued  to  study  organizations,  applying  his 
four-stage  theory  to  various  corporations.  As  a  result  of  his 
research  and  inputs  from  Strassman  and  Withington,  Nolan  ex¬ 
panded  his  data  processing  growth  theory  to  six  stages. 
Fundamental  in  the  expansion  was  the  development  of  data  base 
technology.  The  data  base  technology  costs  represent  another 
S-shaped  curve  to  combine  with  the  overall  data  processing 
learning  curve  (12:457;  24:49).  The  assimilation  of  the  data 
base  technology  is  depicted  in  Figure  3,  which  reflects  the 
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TABLE  I 


Withington's  Five  Generations 
(24:47) 
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Fig  3.  Growth  Curves  Postulated  bv  Nolan 

(24:453) 
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addition  of  two  stages  to  the  growth  theory. 

As  a  basis  for  the  six-stage  growth  theory,  Nolan 
isolated  four  growth  processes  that  determine  the  current 
stage  of  evolution  for  an  organization.  An . explanation  of 
the  four  growth  processes  that  Nolan  monitors  follows: 

1.  The  portfolio  of  computer  applications.  The 
programs  and  procedures  which  are  used  by  the  organi¬ 
zation  in  its  business  activities.  The  applications 
portfolio  represents  the  cumulative  end  product  of 
the  data  processing  organization. 

2.  The  data  processing  organization  and  technical 
capabilities.  The  organization  structures  and 
technical  capabilities  found  within  the  data  proces¬ 
sing  department  which  are  required  to  develop  and 
operate  application  systems.  These  include  data 
processing  management  structure,  hardware  and  soft¬ 
ware  resources,  systems  development  and  operations 
organizations . 

3.  Data  processing  planning  and  management  control 
systems.  The  set  of  organization  practices  used  to 
direct,  coordinate  and  control  those  involved  in  the 
development  and  operation  of  application  systems, 
including  data  processing  planning,  project  manage¬ 
ment,  top  management  steering  committees,  chargeout 
and  performance  measurement. 

4.  The  user.  The  members  of  line  and  staff  depart¬ 
ments  who  must  use  the  applications  systems  to 
perform  their  jobs  [14:9]. 

According  to  Nolan,  the  four  growth  processes  help  to 
provide  unique  characteristics  for  each  of  the  six  stages  of 
data  processing  growth.  The  stages  and  a  brief  explanation 
of  their  characteristics  follow: 

1.  Initiation  -  computer  technology  is  introduced 
and  applied  to  high- volume,  high-payoff  areas  such 
as  accounting. 

2.  Contagion  -  computer  applications  proliferate  in 
functional  areas  throughout  the  organization  so 
employees  may  realize  what  the  computer  can  do. 


3.  Control  -  new  computer  applications  are  restricted, 
and  the  emphasis  shifts  to  documenting  and  improving 
existing  applications  and  the  development  of  formalized 
systems  for  planning  and  controlling  the  computer 
resource . 

4.  Integration  -  limit  data  duplication  by  storing  it 
in  one  place.  Data  base  technology  is  introduced  and 
existing  applications  are  modified  to  utilize  this  new 
technology.  There  is  a  shift  in  emphasis  from  managing 
the  computer  to  managing  the  company's  data  resources. 

5.  Data  Administration  -  data  base  technology  is  used 
to  integrate  existing  applications  on  an  increasingly 
wider  scale,  and  the  functional  manager  must  implement 
control . 

6.  Maturity  -  the  applications  portfolio  is  complete, 
and  it  matches  the  organization  and  information  flows 
in  the  company.  Maturity  takes  place  (5:298-299;  18). 

By  combining  the  explanations  of  the  six  stages  and 
the  four  areas  where  data  processing  growth  takes  place  into 
a  single  figure,  an  example  of  an  organization's  evolution  is 
depicted.  Figure  4  represents  a  typical  organization's  transi 
tion  through  the  six  stages  of  growth.  The  dotted  line  repre¬ 
sents  the  organization's  level  of  expenditures  (S-shaped 
curve)  from  the  introduction  of  the  computer  into  the 
organization  to  the  mature  management  of  information  resources 
Until  mid-stage  3,  management  is  concerned  with  managing  the 
computer.  "At  some  point  in  stage  3,  there  is  a  transition 
to  management  of  data  resources  [15:116]."  This  transition 
not  only  involves  restructuring  the  information  processing 
organization,  but  also  includes  installing  new  management 
techniques . 

The  techniques  used  by  management  play  an  important 
role  in  the  organizational  learning  and  growth  that  takes 
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(15:117) 


place.  Management  must  provide  an  environment  in  which  the 
appropriate  learning  can  take  place  for  the  organization  to 
progress  from  stage  to  stage.  Nolan  refers  to  two  environ¬ 
ments  which  will  guide  an  organization  in  its  growth.  One 
environment  is  called  "control,"  and  the  other  is  called 
organizational  "slack,"  (6:53-55)  which  will  be  referred  to 
as  organizational  "innovation." 

In  the  control  environment,  all  financial  and 
performance  management  systems  -  including  planning, 
budgeting,  project  management,  personnel  performance 
reviews,  and  chargeout  or  cost  accounting  systems  - 
are  used  to  ensure  that  .  .  .  [15:116] 

data/ information  processing  activities  are  effective  and  effi¬ 
cient.  In  the  innovation  environment,  though,  sophisticated 
controls  are  absent  and  there  are  incentives  to  use  informa¬ 
tion  processing  techniques  in  an  experimental  manner.  As  an 
example,  systems  analysts  might  be  assigned  to  users  without 
any  charge  to  the  users'  budgets.  By  creating  the  innovation 
type  environment,  costs  will  be  higher,  but  the  birth  of  new 
ideas  will  take  place  that  are  necessary  for  growth  of  the 
organization  (15:117). 

The  trade-off  between  control  and  innovation  is  criti¬ 
cal  in  developing  an  appropriate  management  emphasis  for  each 
stage  of  organizational  learning.  For  instance,  an  imbalance 
of  high  control  and  low  innovation  in  the  earlier  stages  can 
impede  the  use  of  information  technology  in  the  organization. 
On  the  other  hand,  an  imbalance  of  low  control  and  high  inno¬ 
vation  in  later  stages  can  lead  to  explosive  information 
processing  budget  increases  and  inefficient  systems  (15:117). 
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TABLE  II 


Optimum  Balance  of  Organizational  Innovation 

and  Control 
(15:118) 


Organizational 
Innovation 
Computer  Data 

Organizational 

Control 

Computer  Data 

Objectives 
of  Control 
Systems 

Stage 

1 

Low 

Low 

Stage 

2 

High 

Low 

Facilitate 

Growth 

Stage 

3 

Low 

Low 

High  Low 

Contain 

Supply 

Stage 

4 

High 

Low 

Match  Supply 
and  Demand 

Stage 

5 

Low 

High 

Contain 

Demand 

Stage 

6 

High 

High 

Balance 

Supply  and 
Demand 

Table  II  demonstrates  the  appropriate  balance  of  con¬ 
trol  and  innovation  to  use  through  Nolan's  six  stages  of 
growth.  Notice  that  the  emphasis  of  management  shifts  from 
management  of  the  computer  to  management  of  data  resources. 
This  shift  is  associated  with  the  introduction  of  data  base 
technology  and  explains  the  absence  of  entries  in  the  computer 
columns  after  stage  3. 

Models  such  as  the  one  developed  by  Richard  Nolan  may 
be  of  use  to  the  Air  Staff  for  determining  the  appropriate 
management  emphasis  requisite  in  the  organizational  design  of 
ASIMS.  The  objectives  of  the  control  systems  are  to  influence 
the  supply  and  demand  of  data  processing  applications.  For 
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example,  the  objective  of  stage  3  growth  is  to  contain  or 
restrict  the  supply  of  automated  applications. 


CHAPTER  3 


METHODOLOGY 

The  methodology  used  to  meet  the  research  objectives 
is  discussed  in  this  chapter.  Nolan's  six  criteria  for  speci¬ 
fying  the  stage  of  data  processing  growth  for  a  nonprofit 
organization  are  described  and  then  applied  to  the  Air  Staff. 
Next,  the  method  for  determining  the  current  Air  Staff  growth 
stage  is  presented.  Finally,  the  options  for  organizational 
emphasis  are  discussed. 

Criteria 

Nolan  proposes  a  six-stage  growth  process  for  data 
processing  management.  Six  criteria,  or  benchmarks,  differ¬ 
entiate  the  various  stages  of  growth.  The  six  criteria  are 
expenditure  ratios,  level  of  technology,  types  of  computer 
applications  or  the  applications  portfolio,  data  processing 
organization,  planning  and  control,  and  amount  of  user  aware¬ 
ness.  The  six  criteria  are  divided  into  two  levels  of  analysis. 
The  first  two  criteria  comprise  the  first  level  of  analysis 
and  evaluate  the  stage  of  growth  for  the  organization  as  a 
whole.  The  second  level  of  analysis,  consisting  of  the  last 
four  criteria,  evaluates  the  growth  stage  for  each  division 
within  the  organization  (15:121). 

First  Level  of  Analysis.  The  initial  criteria  for  this 
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level  of  analysis  is  the  expenditure  ratio  for  data  processing. 
Nolan  recommends  calculating  the  ratio  of  data  processing  costs 
to  total  sales.  As  mentioned  in  Chapter  2,  Strassman  first 
suggested  some  type  of  cost/benefit  ratio  be  used  to  measure 
actual  data  processing  growth.  The  use  of  a  ratio  reduces 
the  effects  of  inflation  that  are  found  when  a  single  figure 
such  as  the  data  processing  budget  is  used  to  determine  real 
growth  (24 : 48) . 

When  Nolan  developed  his  growth  stage  theories  in  the 
1970s,  he  studied  50  profit-making  organizations.  His  cost/ 
benefit  ratio  compared  data  processing  costs  to  total  sales. 

In  contrast,  this  research  effort  concerns  the  Headquarters 
of  the  United  States  Air  Force,  a  nonprofit  organization. 
Consequently,  sales  cannot  be  used  as  an  appropriate  denomina¬ 
tor  for  the  expenditure  ratio  criteria.  Following  from 
Strassman' s  conclusions,  a  benefit  or  output  must  be  determined 
for  the  nonprofit  organization  to  calculate  an  expenditure 
ratio  for  Nolan's  first  level  of  analysis.  Anthony  and 
Herzlinger,  in  their  book  Management  Control  In  Nonprofit 
Organizations ,  state  that  it  is  difficult  to  measure  the  out¬ 
put  of  a  nonprofit  organization,  and  even  in  profit  organiza¬ 
tions  revenue  is  rarely  a  complete  expression  of  outputs  (3:6). 
The  two  authors  go  on  to  say,  "...  outputs  should  equal 
inputs  [3:39]"  in  nonprofit  organizations  and  that  inputs  can 
be  an  acceptable  measure  of  outputs  (3:249).  In  addition, 
economists  contend  that  the  benefit  of  national  defense 
should  be  valued  at  cost,  hence  th.  budget  (26:44).  Therefore, 
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this  analysis  uses  the  ratio  of  the  Air  Staff  data  processing 
budget  to  the  total  Air  Staff  budget  to  determine  Nolan's 
expenditure  ratio  for  the  first  level  of  analysis.  If  the 
expenditure  ratio  is  constant  over  time,  then  the  Air  Staff 
is  in  stage  1,  Initiation,  or  stage  6,  Maturity.  If  the  ratio 
is  increasing  over  time,  then  the  Air  Staff  is  in  stage  2, 
Contagion,  or  stage  4,  Integration.  If  the  ratio  is  decreas¬ 
ing  over  time,  then  the  Air  Staff  is  in  stage  3,  Control,  or 
stage  5,  Data  Administration.  Consequently,  the  first  cri¬ 
teria  will  narrow  the  Air  Staff's  stage  of  growth  down  from 
any  of  the  six  to  two  stages  (15:121). 

The  second  criteria,  level  of  technology,  is  the  final 
element  in  the  first  level  of  analysis.  Technology  examines 
the  type  and  percentage  of  different  processing  techniques 
within  the  Air  Staff.  The  level  of  technology  within  the  Air 
Staff  will  approximate  one  of  the  six  criteria  in  Figure  5. 

The  combination  of  the  first  and  second  criteria  complete  the 
first  level  of  analysis.  Both  criteria  offer  an  indication 
of  the  overall  range  of  the  various  Air  Staff  organizational 
units  in  terms  of  data/information  growth. 

Second  Level  of  Analysis.  The  second  level  of  analysis 
defines  the  growth  stages  for  each  of  the  Air  Staff  organiza¬ 
tional  units  analyzed  in  this  research  (see  Table  III).  All 
of  the  second  level  criteria  were  not  applicable  to  each  unit. 
For  example,  each  section  did  not  have  a  data  processing 
organization,  in  which  case  that  particular  criteria  was  not 
evaluated  for  the  unit.  After  applying  each  criteria  in  the 


Tracks  Exceeds  Is  Less  Exceeds  Is  Less  Tracks 

Rate  of  Rate  of  Than  Rate  Rate  of  Than  Rate  Rate  of 

Expenditure  Budget  Budget  of  Budget  Budget  of  Budget  Budget 
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TABLE  III 


Department  of  the  Air  Force  Organizational  Units 

(41:1) 


Acronym 

Full  Name 

OSAF 

Office  of  the  Secretary  of  the  Air  Force 

AC 

Comptroller  of  the  Air  Force 

NGB 

Chief  of  the  National  Guard  Bureau 

DA 

Director  of  Administration 

HC 

Chief  of  Chaplains 

IG 

Inspector  General 

IN 

Assistant  Chief  of  Staff,  Intelligence 

JA 

Judge  Advocate  General 

LE 

DCS/Logistics  and  Engineering 

MP 

DCS/Manpower  and  Personnel 

NB 

USAF  Scientific  Advisory  Board 

PR 

DCS/Programs  and  Resources 

RD 

DCS/Research,  Development  and  Acquisition 

RE 

Chief  of  the  Air  Force  Reserve 

SA 

Assistant  Chief  of  Staff,  Studies  and  Analysis 

XO 

DCS/Plans  and  Operations 

1947th 

1947th  Air  Staff  Administrative  Support  Group 

DSC 

Air  Force  Data  Services  Center 

second  level  of  analysis  to  the  various  units  within  the  Air 
Staff,  a  range  of  growth  in  the  Air  Staff  was  determined. 

The  criteria  for  the  second  level  of  analysis  is  depicted  in 
Figure  6. 

The  growth  stage  for  the  applications  portfolio  cri¬ 
teria  reflects  the  types  of  applications  used  in  each  unit 
(25:101).  In  general,  the  organizational  unit  is  in  stage  1 
to  2  if  ".  .  .  there  is  a  concentration  on  labor-intensive 
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(15:121) 


automation,  scientific  support,  and  clerical  replacement  [15: 
121]."  If  the  applications  are  located  with  the  user  for 
data  generation  and  use,  then  the  unit  is  in  stage  3  or  4. 

If  a  balance  is  achieved  with  decentralized  user  applications 
and  centralized  data  bases  and  common  systems,  then  the  unit 
is  in  stage  5  or  6  (15:121). 

The  data  processing  organization  criteria  differenti¬ 
ates  the  units  into  groups  that  include  two  stages  of  growth. 
If  the  processing  function  is  a  centralized  "closed  shop," 
the  unit  is  in  stage  1  or  2.  If  the  processing  function  is 
merely  a  data  custodian  and  the  outputs  are  useful  and  reli¬ 
able,  then  the  unit  is  in  stage  3  or  4.  If  the  organizational 
unit  has  accepted  the  data/information  resource  concept  and 
responsibility  for  processing  is  appropriately  dispersed,  then 
the  unit  is  in  stage  5  or  6  (15:121). 

The  data  processing  planning  and  control  criteria 
differentiates  between  stages  1  through  3  and  4  through  6. 

If  internal  planning  and  control  is  focused  on  the  computer 
with  "...  standards  for  programming,  responsibility  account¬ 
ing,  and  project  management  [15:121],"  then  the  unit  is  in 
one  of  the  first  three  stages  of  growth.  If  the  unit's 
external  planning  and  control  is  focused  on  data/information 
resource  management  with  ",  .  .  value-added  user  chargeback, 
a  steering  committee,  and  data  administration  [15:121]."  then 
the  unit  is  in  the  last  three  stages. 

The  final  criteria,  user  awareness,  is  more  definitive 
than  planning  and  control.  If  the  user  restricts  his  knowledg 
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and  use  of  automated  systems  to  replace  existing  manual 
processes,  then  the  unit  is  in  stage  1  or  2.  If  the  users 
within  the  unit  are  responsible  for  data  entry,  use,  and 
quality,  then  the  unit  is  in  stage  3  or  4 .  If  the  unit  end 
users  and  the  data/information  processing  organization  are 
jointly  responsible  for  the  data/information  entry,  quality, 
and  applications,  then  the  unit  has  entered  stages  5  and  6 
(15:121) . 

All  four  of  these  criteria  were  combined  for  each 
unit  before  assigning  the  unit  to  a  given  overall  stage.  Any 
one  of  the  criteria  might  overlap  several  stages.  Therefore, 
the  most  complete  assessment  considered  all  four  criteria. 

Stage  Determination  Process 

The  data  collected  determined  the  degree  to  which 
the  Air  Staff  and  each  of  its  units  met  the  criteria  for 
stage  determination.  When  compared  against  the  criteria,  the 
data  collected  for  expenditure  ratios  and  level  of  technology 
gave  the  results  for  the  first  level  of  analysis.  This  data 
determined  the  growth  stage  of  the  Air  Staff  as  a  whole. 

All  four  second  level  criteria  specified  the  stage  of 
growth  for  the  separate  Air  Staff  units.  Each  criteria  had 
equal  weight  in  stage  determination.  Since  the  data  collected 
for  the  second  level  of  analysis  is  ordinal  data,  when  a  unit 
falls  into  a  certain  stage  it  must  not  be  compared  to  other 
units  in  that  stage  of  growth  (23:38-40).  In  other  words, 
once  an  Air  Staff  unit  is  designated  in  a  stage  of  growth  for 
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a  specific  criteria,  that  unit  is  equal  to  all  other  units 
in  that  stage  due  to  the  nature  of  the  data.  Values  were 
assigned  for  the  stage  of  each  criteria  and  then  divided  by 
the  number  of  criteria  used  to  determine  each  unit's  overall 
stage  of  growth  as  depicted  in  Table  IV. 


TABLE  IV 

Example  Evaluation 


Stages  for 

a  Given  Criteria 

Unit 

Applica¬ 

tions 

Portfolio 

DP 

Organi¬ 

zation 

DP  Plan-  User 

ning  §  Aware- 

Control  ness 

Overall 

Unit  Growth 
Stage 

Air 

Staff 

Unit 

3.5 

1.5 

2.0  3.5 

2.685 

Notice  that  when  a  specific  criteria  covers  more  than 
one  stage,  the  value  associated  with  that  range  is  the  mid¬ 
point  of  the  stages,  such  as  3.5  for  the  application^  port¬ 
folio  criteria  for  the  example  in  Table  IV.  According  to 
Nolan's  model,  each  second  level  analysis  criteria  is  con¬ 
sidered  equal  in  weight,  allowing  for  a  mean  value  of  the 
criteria  to  be  used  in  determining  the  overall  stage  of 
growth  for  each  Air  Staff  organizational  unit. 

Following  the  individual  unit  analysis,  a  summary 
table  was  made  for  all  Air  Staff  units.  The  stage  of  growth 
range  for  all  units  provided  a  basis  for  determining  the  type 
of  organizational  design  to  be  used  when  implementing  ASIMS 
and  will  indicate  less  developed  units  that  need  increased 
attention.  The  combination  of  the  first  level  and  second 
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level  analysis  provides  an  Air  Staff-wide  profile  of  its  data 
processing  growth  stages. 

Organizational  Emphasis 

Knowledge  of  the  growth  stage  determines  the  appropri¬ 
ate  organizational  design  to  be  used  in  implementing  ASIMS. 
The  desired  organizational  design  will  apply  the  needed  inno¬ 
vation  and  control  to  promote  the  growth  of  data/information 
processing  within  the  Air  Staff.  The  optimum  relationship 
for  each  stage  was  shown  in  Table  II.  By  combining  the  re¬ 
sults  in  the  summary  table  and  the  guidance  in  Table  II,  the 
ASIMS  management  can  apply  the  appropriate  emphasis  in  terms 
of  innovation  and  control  for  the  individual  units.  As  the 
growth  of  data  processing  continues,  the  organizational 
emphasis  can  be  adjusted  accordingly. 
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CHAPTER  4 


DATA  COLLECTION 

The  quality  of  any  analysis  is  a  function  of  the 
quality  of  its  data.  The  data  for  this  research  were  obtained 
from  several  authoritative  sources  in  the  Pentagon.  The 
organizations  which  provided  data  relevant  to  the  Air  Staff 
were  the  Air  Force  Data  Services  Center  (AFDSC) ,  the  1947th 
Support  Group,  and  the  ASIMS  Working  Groups.  The  AFDSC,  a 
part  of  the  Air  Force  Communications  Command,  is  responsible 
for  providing  data  processing  support  to  the  Air  Staff  and 
the  OSAF.  The  1947th  Support  Group  provides  administrative 
support  to  the  Air  Staff  and  the  OSAF.  The  two  ASIMS 
Working  Groups  are  the  Advisory  Group  (AG)  and  the  Informa¬ 
tion  Systems  Architecture  (ISA)  Working  Group.  The  AG  is 
composed  of  senior  personnel  who  have  ",  .  .a  broad  knowledge 
and  understanding  of  the  information  system  requirements  of 
the  functional  office  they  are  representing  [7:22].”  The  ISA 
Working  Group  members  develop  detailed  analysis  "...  needed 
to  support  the  functional  and  staff  mission  of  their  respec¬ 
tive  organizations  [7:22].”  Most  of  the  data  was  obtained 
in  Air  Force  budget  publications  (20;  21;  32;  33;  34;  35;  36; 
37;  38;  39;  40)  and  through  interviews  (4;  10;  16;  17;  22;  27) 
coordinated  with  Lt.  Col.  Arlyn  D.  Schumaker  at  the  Pentagon 
from  14-17  June  1982. 
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Data  for  First  Level  of  Analysis 

The  first  level  of  analysis  requires  budget  and  level 
of  technology  data.  The  Air  Staff  data  processing  budget 
(Table  V)  and  total  Air  Staff  budget  (Table  VI)  data  were 
provided  by  Gilbert  (10)  and  ^ayne  (16)  ,  respectively. 

TABLE  V 


Air  Staff  Data  Processing  Budget 
(10) 


Fiscal  Year 

Budget  ($  in  thousands) 

1977 

16,043 

1978 

23,628 

1979 

19,951 

1980 

21,658 

1981 

29,609 

1982* 

35,888 

1983* 

46,753 

*  Estimates 

TABLE  VI 

Total  Air  Staff  Budget 
(16) 


Fiscal  Year 

Budget  ($  in  thousands) 

1977 

128,751 

1978 

129,161 

1979 

115,890 

1980 

123,557 

1981 

149,471 

1982* 

168,205 

1983* 

181,799 

*  Estimates 
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Gilbert  monitors  the  Air  Staff  data  processing  budget  and 
he  compiled  the  data  by  using  the  President's  Budget:  ADP 
Cost  Summary  and  Justification  of  Estimates  budget  documents. 
Excerpts  of  these  budget  documents  are  presented  in  Appendices 
B  and  C.  Payne  compiled  all  elements  for  the  entire  Air  Staff 
budget  using  procurement,  operations  and  maintenance,  and 
personnel  budgets  (16) . 

The  level  of  technology  data  (Figure  7)  was  collected 
during  three  interviews.  The  interviews  were  conducted  with 
the  ASIMS  Interview  Guide/Questionnaire  (Appendix  A) . 

Question  1  was  used  to  determine  the  level  of  technology 
benchmark.  The  question  asked  each  respondent  to  ma  ch  the 
Air  Staff  level  of  technology  with  one  of  Nolan's  six  stage 
descriptions.  Mr.  Petroski  (17)  and  Lt.  Col.  Tufts  (27) 
stated  the  Air  Staff  most  closely  matched  stage  4.  Lt.  Col. 
Caswell  (4)  stated  the  Air  Staff  represented  stage  4  moving 
to  stage  5.  Mr.  Petroski  is  responsible  for  managing  the 
AFDSC  computer  systems.  Lt.  Col.  Tufts  manages  the  applica¬ 
tions  programs  for  the  Air  Staff  budget  and  financial  systems. 
Lt.  Col.  Caswell  is  responsible  for  all  other  Air  Staff 
applications  programs.  The  four  remaining  questions  relate 


«  * 

# 

1  t  3 

@  -  Mr.  Petroski  (17) 

#  -  Lt.  Col.  Tufts  (27) 

*  -  Lt.  Col.  Caswell  (4) 

4 

5 

6 

Fig  7.  Air  Staff  Level  of  Technology 
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to  the  four  growth  processes  in  Nolan's  second  level  of 
analysis . 

Data  for  the  Second  Level  of  Analysis 

The  ASIMS  Advisory  Group  and  ISA  Working  Group  responses 
to  Questions  2  through  5  are  summarized  in  Table  VII.  Ques¬ 
tions  2,  3,  and  5  asked  each  respondent  to  match  their  organi¬ 
zational  unit's  application  portfolio,  data  processing  organi¬ 
zation,  and  user  awareness  with  one  of  Nolan's  three  respective 
descriptions  from  Figure  6.  Question  4  asked  each  respondent 
to  match  their  organizational  unit's  data  processing  planning 
and  control  with  one  of  Nolan's  two  descriptions  from  Figure 
6.  The  wording  of  the  responses  conforms  to  Nolan's  descrip¬ 
tions  to  avoid  undue  bias.  Consequently,  each  response  will 
be  an  average  of  two  or  three  stages.  Therefore,  an  "A" 
response  to  Questions  2,  3,  and  5  will  be  the  average  of 
stages  1  and  2,  or  1.5.  Likewise  a  "B"  response  is  3.5,  and 
a  "C"  response  is  5.5.  Question  4  responses  of  "A"  and  "B" 
translate  to  2  and  5,  respectively.  The  loss  of  precision  by 
using  the  average  is  not  the  only  data  limitation. 

Data  Limitations 

The  budget  data  for  the  first  level  of  analysis  was 
limited  to  seven  years.  Prior  budget  data  was  located  in  the 
Air  Force  Archives,  and  not  accessible  within  the  time  con¬ 
straints  of  the  research  project.  The  older  the  data  source, 
the  more  difficult  it  was  for  the  budget  specialists  to  insure 
the  data  was  composed  of  common  inputs  due  to  changing 
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TABLE  VII 


Air  Staff  Interview/Questionnaire  Responses 


Respondent 

Unit 

Question 

Number 

2 

3 

4 

5 

1 

ACM 

A 

B 

B 

B 

2 

ACM 

A 

B 

B 

B 

3 

DA 

C 

C 

B 

C 

4 

DA 

C 

C 

B 

C 

5 

HC 

A 

A 

A 

B 

6 

HC 

A 

A 

A  • 

B 

7 

IG 

NO 

DP  Stage  1 

8 

IN 

B 

A 

A 

C 

9 

IN 

A 

B 

A 

A 

10 

JA 

A 

B 

B 

C 

11 

LE 

C 

C 

B 

C 

12 

LE 

A 

- 

- 

B 

13 

MP 

C 

C 

A 

B 

14 

MP 

B 

B 

A 

C 

15 

NB 

A 

- 

- 

A 

16 

PR 

B 

C 

A 

B 

17 

PR 

B 

A 

A 

C 

18 

RD 

A 

B 

A 

A 

19 

RE 

C 

B 

A 

B 

20 

SA 

A 

C 

A 

B 

21 

SA 

A 

C 

A 

B 

22 

XO 

B 

B 

A 

B 

23 

XO 

B 

B 

A 

B 

24 

NGB 

B 

A 

A 

B 

25 

NGB 

B 

B 

A 

A 

26 

1947 

B 

C 

A 

C 

27 

AFDSC 

B 

B 

A 

A 

28 

AFDSC 

B 

B 

A 

C 

29 

OSAF 

B 

“ 

- 

C 

accounting  policies  and  new  administrations  (10:16). 

The  validity  of  the  second  level  of  analysis  is  depend 
ent  upon  the  level  of  experience  and  knowledge  of  the  respond 
ents.  The  Comptroller  of  the  Air  Force  (AC)  respondents 
based  their  comments  upon  the  Cost  and  Management  Analysis 
Division  (ACM)  only.  Consequently,  the  researchers  were  un¬ 
able  to  get  responses  from  two  heavy  data  processing  users, 
the  Computer  Resources  and  Budget  Divisions  in  AC.  Most 


organizations  have  two  representatives  who  responded  independ¬ 
ently.  However,  some  organizations  may  have  only  one  repre¬ 
sentative  in  the  ASIMS  group  or  only  one  who  responded 
independently. 


38 


CHAPTER  5 


DATA  ANALYSIS 

This  chapter  analyzes  the  data  collected  during  the 
research  visit  to  the  Pentagon.  The  first  level  of  analysis 
is  presented  and  followed  by  the  second  level  analysis.  The 
results  of  both  analyses,  with  respect  to  Nolan's  growth 
theory,  provides  the  guidelines  for  determining  the  organiza¬ 
tional  emphasis  to  be  employed  at  the  Air  Staff,  which  is  the 
final  element  of  this  chapter. 

First  Level  of  Analysis 

The  first  level  of  analysis  is  comprised  of  the  expen¬ 
diture  and  technology  benchmarks  (criteria)  as  described  in 
Figure  5.  The  expenditure  ratio  benchmark  is  calculated  from 
the  ratio  of  the  budget  data  in  Tables  V  and  VI  for  the  seven 
years  of  data  available.  The  ratios  and  the  change  from  year 
to  year  are  reflected  in  Table  VIII. 

Another  representation  of  the  expenditure  ratio  is 
depicted  in  Figure  8,  which  symbolizes  the  S- shaped  curve 
discussed  in  Chapter  2.  Assuming  a  constant  rate  of  inflation 
for  both  the  data  processing  budget  and  the  total  Air  Staff 
budget,  the  resulting  change  in  the  ratios  from  year  to  year 
represents  the  real  growth  in  the  data  processing  budget. 

The  expenditure  ratio  graph  shows  a  rise  in  the  data  processing 
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TABLE  VIII 


Air  Staff  Expenditure  Ratios 


FY 

Ratio 

Year-to-Year  Change 

1977 

.1246 

1978 

.  1829 

+.0583 

1979 

.1722 

- .0107 

1980 

.1753 

+  .0031 

1981 

.1981 

+.0228 

1982* 

.2134 

+.0153 

1983* 

.2572 

+.0438 

*  Estimates  | 
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Fig  8.  Changes  in  Expenditure  Ratios 
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expenditures  relative  to  the  total  Air  Staff  budget.  The  in¬ 
crease  in  the  data  processing  budget  relative  to  the  overall 
budget  indicates  that  the  Air  Staff  is  in  stage  2  or  stage  4 
for  the  expenditure  ratio  benchmark  of  Nolan's  growth  theory. 

The  second  criteria  or  benchmark  in  the  first  level  of 
analysis  is  the  determination  of  the  existing  technology  with¬ 
in  the  Air  Staff  and  the  OSAF  where  AS I MS  will  be  introduced. 

A  similar  response  was  received  from  the  three  computer  mana¬ 
gers  interviewed  at  the  Air  Staff.  As  shown  in  Figure  7,  the 
experts  agree  that  the  existing  equipment  usage  is  best  re¬ 
flected  by  that  found  in  stage  4.  Nolan  describes  stage  4 
technology  as: 

-  50  percent  batch  and  remote  job  entry  processing 

-  40  percent  data  base  and  data  communications 
processing 

-  5  percent  personal  computing 

-  5  percent  minicomputer  and  microcomputer  processing 

Combining  the  results  from  the  two  criteria  in  the 

first  level  of  analysis,  the  Nolan  data  processing  stage  of 
growth  that  currently  best  represents  the  Air  Staff  and  the 
OSAF  is  stage  4,  Integration.  The  Integration  stage  is 
characterized  by  a  shift  in  emphasis  from  managing  the  com¬ 
puter  to  managing  data  resources.  Data  base  technology  is 
introduced  and  existing  applications  are  modified  to  utilize 
this  new  technology.  Stage  4  best  describes  the  Air  Staff  as 
a  whole  at  this  time,  and  determines  the  organizational 
emphasis  to  apply  in  terms  of  control  and  innovation. 


41 


TABLE  IX 


Second  Level  of  Analysis  Evaluation  Summary 


Unit 


ACM 

ACM 

DA 

DA 

HC 

HC 

IG 

IN 

IN 

JA 

LE 

LE 

MP 

MP 

NB 

PR 

PR 

RD 

RE 

SA 

SA 

XO 

XO 

NGB 

NGB 

1947th 

AFDSC 

AFDSC 

SAF 


Applica- 

tions 

Portfolio 


Organi¬ 

zation 


DP  Plan¬ 
ning  § 
Control 


User 

Aware¬ 

ness 


Overall 
Unit  Growtl 
Stage 


3.375 

5.375 

1.625 

1.000 

2.625 
3.875 

3.927 

3.875 

1.500 

3.375 

2.125 

3.625 

3.125 

3.125 

2.625 

4.125 

3.125 

4.500 


Second  Level  of  Analysis 

The  second  level  of  analysis  is  based  upon  the  responses 
(listed  in  Table  VII)  to  Questions  2  through  5  of  the  ASIMS 
interview  guide/questionnaire.  As  described  in  Chapter  3,  the 
responses  for  a  given  directorate  or  division  are  averaged  to 
provide  an  overall  growth  stage.  Table  IX  lists  the  numerical 


values  assigned  to  each  response  for  the  Advisory  Group  and 


the  ISA  Working  Group  members  interviewed.  A  summary  chart 
(Figure  9)  depicts  the  overall  growth  stage  for  each  of  the 
18  Air  Staff  units  studied  in  the  second  level  of  analysis. 

A  wide  range  of  growth  stages  is  depicted  in  Figure  9,  reflect¬ 
ing  the  varied  degrees  of  data  processing  evolution  at  the 
Air  Staff.  A  summary  chart  reveals  that  one-half  of  the 
individual  directorates  or  divisions  fall  between  stage  3  and 
stage  4.  This  grouping  of  units  further  supports  the  results 
of  the  first  level  of  analysis. 


LE 

DSC  KIT 

NGB  T<r  PR  MP 

IG  NB  HC  RD  “T5T  ACM  JA  1947  SAF  DA 

T  2  3  4  S  6 

Growth  Stages 


Fig  9.  Second  Level  Analysis:  Unit 
Overall  Growth  Stage 

Organizational  Emphasis 

Management  techniques  applied  in  organizations  play  an 
important  role  in  the  amount  of  learning  and  growth  that  takes 
place.  Management  should  provide  an  environment  in  which  the 
appropriate  changes  can  take  place  for  the  organization  to 
progress  from  stage  to  stage.  As  discussed  in  Chapter  2, 

Nolan  referred  to  the  two  environments  of  organizational 
emphasis  that  guide  an  organization  in  its  growth.  The  two 
environmental  factors,  innovation  and  control,  must  be  deli¬ 
cately  balanced  to  allow  for  evolution  through  the  stages  of 
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Air 

Staff 

Units 


data  processing. 


The  results  from  the  first  level  of  analysis,  coupled 
with  the  guidance  in  Table  II,  indicate  the  appropriate  inno¬ 
vation  and  control  for  the  Air  Staff  at  present.  By  being  in 
stage  4,  the  Air  Staff  should  emphasize  high  innovation  and 
low  control.  The  objective  of  this  organizational  emphasis 
is  to  remove  management  control  on  the  use  of  data  and  allow 
users  to  be  innovative.  This  approach  will  facilitate  the 
user's  knowledge  and  use  of  data  base  systems. 

The  overall  Air  Staff  organizational  emphasis  of  high 
innovation  and  low  control  may  not  be  applicable  to  all  of 
its  units.  The  optimal  emphasis  must  consider  the  growth 
stage  of  the  unit  as  shown  in  Figure  9.  Units  in  stages  1, 

2,  or  entering  3,  emphasize  the  use  and  control  of  the  com¬ 
puter.  During  stage  3  and  continuing  through  stage  6,  units 
shift  emphasis  to  managing  data  rather  than  concentrating  on 
management  of  the  computer.  The  combination  of  the  Organiza¬ 
tional  Summary  in  Table  IX  with  the  Optimum  Balance  of 
Organizational  Innovation  and  Control  in  Table  II  determines 
the  Unit  Optimal  Organizational  Emphasis  as  shown  in  Table  X. 
Table  X  can  be  a  guide  for  modifying  the  overall  Air  Staff 
emphasis  to  fit  the  growth  stage  of  its  individual  units. 

For  units  that  are  in  stage  3,  innovation  and  control 
apply  to  both  the  computer  and  data.  Stage  3  is  the  transi¬ 
tion  point  from  managing  the  computer  to  managing  the  data, 
and  requires  unique  combinations  of  innovation  and  control 
as  depicted  in  Table  X. 


TABLE  X 


Unit  Optimal  Organizational  Emphasis 


Unit 

Overall 

Growth 

Stage 

Innovation 

Control 

High 

Low 

High 

Low 

ACM 

3.375 

C$D 

C 

D 

DA 

5.375 

D 

D 

HC 

1.625 

C 

C 

IG 

1.000 

C 

C 

IN 

2.625 

C 

C 

JA 

3.875 

CSD 

C 

D 

LE 

3.927 

C&D 

C 

D 

MP 

3.875 

C$D 

C 

D 

NB 

1.500 

C 

C 

PR 

3.375 

C$D 

C 

D 

RD 

■  2.125 

C 

C 

RE 

3.625 

C§D 

C 

D 

SA 

3.125 

CSD 

C 

D 

XO 

3.125 

C5D 

C 

D 

NGB 

2.625 

C 

C 

1947th 

4.125 

D 

D 

AFDSC 

3.125 

C§D 

C 

D 

SAF 

4.500 

D 

D 

C  -  Computer  D  -  Data 

CHAPTER  6 


CONCLUSIONS,  OBSERVATIONS  AND  RECOMMENDATIONS 

The  Air  Staff  is  a  complex  organization  with  many  and 
varied  data  processing  functions  and  information  requirements. 
An  Air  Staff  Information  Management  System  is  being  developed 
to  satisfy  the  expanding  information  requirements  of  the  Air 
Staff  and  the  OSAF.  The  results  cf  this  research  effort 
should  provide  insight  to  the  existing  data  processing  func¬ 
tion  within  the  Air  Staff  as  a  basis  for  preparing  to  imple¬ 
ment  ASIMS.  The  Conclusions,  Observations  and  Recommenda¬ 
tions  of  this  project  address  the  three  research  objectives 
and  provide  insight  for  the  preparation  necessary  to  implement 
ASIMS. 

Conclusions 

Three  research  objectives  were  proposed  as  goals  for 
accomplishing  this  study.  The  first  objective  was  to  modify 
Nolan's  data  processing  growth  model  and  criteria  for  a  non¬ 
profit  military  organization.  Next,  apply  the  modified  theory 
to  the  overall  Air  Staff  and  its  major  divisions  to  determine 
the  stage  of  growth.  The  third  objective  was  to  recommend 
the  organizational  emphasis  needed  to  prepare  the  Air  Staff 
for  the  implementation  of  ASIMS. 
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The  following  conclusions  were  based  upon  the  data 
analysis.  First,  Nolan's  data  processing  growth  stage  model 
can  be  modified  for  a  nonprofit  organization.  The  modifica¬ 
tions  are  minor  and  justified  by  other  stage  theorists  and 
authorities  on  nonprof it organi zations .  Next,  by  applying  the 
modified  criteria,  it  was  determined  that  the  Air  Staff  is  in 
stage  4,  Integration.  Stage  4  indicates  the  Air  Staff  has 
progressed  from  managing  the  computer  to  managing  data  re¬ 
sources.  The  third  conclusion  of  the  research  is  that  the 
optimal  organizational  design  for  the  Air  Staff  is  high  inno¬ 
vation  and  low  control.  High  innovation  is  accomplished  by 
encouraging  many  new  applications  programs  and  committing  more 
computer  resources  than  are  absolutely  required.  Low  control 
is  achieved  by  relaxing  controls  on  data  processing  applica¬ 
tions,  while  deemphasizing  effectiveness  and  efficiency. 
Caution  should  be  taken  because  the  overall  emphasis  may  need 
to  be  modified  for  each  unit  within  the  organization.  Since 
the  Air  Staff  is  composed  of  units  in  stages  of  growth  from 
1  to  6,  each  unit  will  require  a  particular  combination  of 
innovation  and  control. 

Observations 

Several  observations  were  made  during  the  research  that 
will  impact  the  implementation  of  ASIMS.  Many  of  the  per¬ 
sonnel  interviewed  stated  that  security  was  a  major  obstacle 
to  automated  data  processing  growth  (4;  20;  27).  The  lack  of 
adequate  secure  hardware  prevented  the  automation  of  routine 


classified  tasks  throughout  the  Air  Staff.  The  proper  secur¬ 
ity  is  essential  for  Air  Staff  operations,  but  the  slow 
development  of  this  technology  and  its  incorporation  into 
ASIMS  could  adversely  impact  the  cost  and/or  schedule  of  ASIMS. 

Those  interviewed  also  indicated  that  only  a  small  por¬ 
tion  of  the  potential  data  processing  applications  were  being 
used.  In  other  words,  the  Air  Staff  has  automated  some  com¬ 
plex  applications,  but  could  automate  many  more  functions. 

Some  respondents  indicated  only  10  to  15  percent  of  the  pos¬ 
sible  applications  are  automated  (20;  27).  Consequently,  the 
users  of  automated  processing  foresee  a  need  for  many  more 
applications.  The  recommended  organizational  design  encour¬ 
ages  developing  many  more  applications.  Therefore,  ASIMS 
must  anticipate  a  significantly  larger  number  of  users  and 
applications  than  currently  exist. 

The  final  observation  was  made  while  collecting  the 
second  level  of  analysis  data.  Several  Air  Staff  members 
interpreted  the  data  gathering  questions  differently  than 
anticipated.  The  question  content  was  clarified  during  the 
interviews  so  that  answers  were  based  on  like  interpretations. 
The  unanticipated  ambiguity  in  the  data  collection  instrument 
is  a  potential  area  of  concern  for  future  researchers. 

Recommendations 

The  overall  goal  of  ASIMS  is  to  provide  timely,  accu¬ 
rate,  and  consistent  information  for  Air  Staff  and  Office  of 
the  Secretary  of  the  Air  Force  problem-solving  and  decision- 
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making  (7:11).  To  gain  efficiencies  and  economies  in  informa¬ 
tion  processing,  the  Air  Staff  must  promote  the  evolution  of 
data  processing.  Nolan  offers  a  six-stage  theory  that  depicts 
the  evolution  of  data  processing  and  provides  guidance  for 
remaining  on  the  growth  path.  Nolan's  model  successfully  por¬ 
trays  various  profit  organizations,  which  with  minor  modifica¬ 
tions  is  applied  to  the  Air  Staff.  The  analysis  concluded 
the  overall  Air  Staff  is  in  stage  4  and  revealed  a  wide 
spectrum  of  existing  data  processing  growth  at  the  Air  Staff. 
To  attain  the  goals  of  ASIMS,  every  effort  should  be  made  to 
advance  the  deficient  units  so  when  ASIMS  is  implemented  all 
units  can  take  full  advantage  of  the  system's  capabilities. 

The  recommended  unit  emphasis  displayed  in  Table  X  provides 
the  best  guide  for  the  Air  Staff  at  the  present  time. 

Besides  the  above  general  recommendations,  the  follow¬ 
ing  specific  suggestions  will  prepare  the  Air  Staff  for  the 
implementation  of  ASIMS: 

1.  The  Air  Staff  conduct  an  annual  review  of  its  data 
processing  growth  using  Nolan's  modified  model. 

2.  Revise  the  interview  guide/questionnaire  to  reflect 
the  data  processing  terminology  used  within  the 
Air  Staff  to  remove  ambiguity. 

3.  The  ASIMS  Executive  Committee  review  the  yearly 
analysis  and  specify  appropriate  guidance  in  terms 
of  organizational  and  unit  innovation  and  control. 

4.  Develop  a  functional  model  of  the  Air  Staff. 
Functional  modeling  defiles  the  tasks  and 
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relationships  of  the  Air  Staff  members  and  the 
Air  Staff  units. 


5.  The  ISA  Working  Group  continue  making  a  detailed 
information  flow  analysis  and  then  develop  an 
information  model  from  the  findings. 

6.  Use  the  functional  model  and  information  model  to 
design  and  implement  AS  IMS. 

The  research  accomplished  in  this  thesis,  combined 
with  future  efforts,  will  help  the  Air  Staff  Information 
Management  System  to  provide  timely,  accurate,  and  consistent 
information  for  Air  Force  problem-solving  and  decision-making. 


APPENDIX  A 


ASIMS  INTERVIEW  GUIDE/QUESTIONNAIRE 


DEPARTMENT  OF  THE  AIR  FORCE 
AIR  FORCE  INSTITUTE  OF  TECHNOLOGY  (ATCl 
WRIQHT- FATTER  SON  AIR  FORCE  BASE.  OH  4*433 


1 9  MAY  1982 


LS  (Major  Ronald  H.  Raich,  AUTOVON  785-4549/Conmercial  (513)  255-4549) 
Air  Staff  Information  Management  System 


HQ  USAF/CVAD(S)  (Lt  Col  Arlyn  Schumaker) 

1,  The  Air  Force  Institute  of  Technology  (AFIT)  is  currently  involved  with 
the  Air  Staff  concerning  the  implementation  of  effective  information  systems. 
In  response  to  a  request  from  the  Office  of  Information  Resource  Management, 
AFIT  has  agreed  to  conduct  relevant  research  regarding  the  Air  Staff  Informa¬ 
tion  Management  System  (ASIMS). 

2,  Two  master's  degree  candidates  in  the  Systems  Management  Program  ac  AFIT 
(Captains  Larry  G.  Radov  and  Stanley  A.  Sneegas)  are  conducting  thesis 
research  under  chc  guidance  of  the  AFIT  graduate  faculty  (Major  Ronald  H. 
Reach).  They  have  defined  a  research  objective  which  will  determine  the  cur¬ 
rent  state  of  data  processing  growth  within  the  Air  Staff.  Based  on  this 
objective,  they  will  be  able  to  provide  recommendations  regarding  current  and 
future  actions  concerning  the  management  of  ASIMS. 

3,  To  achieve  the  stated  objective.  Captains  Radov  and  Sneegas  require 
information  concerning  the  relationship  between  the  data/ information  pro¬ 
cessing  budget  and  total  Air  Staff  budget  for  the  past  15  years.  They  also 
require  your  expertise  with  regard  to  determining  the  present  level  of  com¬ 
puter  processing  technology  at  the  Air  Staff,  as  indicated  in  Question  1  of 
the  attached  questionnaire.  Further,  they  request  chat  each  member  of  the 
Information  Systems  Architecture  (ISA)  Working  Group  provide  information 
regarding  present  level  of  computer  processing  technology,  types  of  data 
processing  applications,  organization,  planning  and  control,  and  user  aware¬ 
ness  within  their  respective  organization.  These  areas  are  addressed  in 
Questions  1  through  5  of  the  attached  questionnaire. 


4.  Captains  Radov  and  Sneegas  will  be  at  the  Pentagon  from  14-16  June  to 
discuss  the  above  subjects  with  members  of  the  ISA  Working  Group.  Your 
cooperation  in  this  important  research  project  is  essential  to  its  completion 
and  your  responses  vill  be  held  confidential.  Your  views  are  essential  Co 
avoid  mi«fea4ing  conclusions. 
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Questionnaire 


:ing  Dean 
'School  of  Systems  and  Logistics 


A*  PO#CE— a  GW  at  way  Of  ure 


ASIMS  INTERVIEW  GUIDE/QUESTIONNAIRE 


1)  Select  the  state  of  technology  in  data/information  pro¬ 
cessing  that  most  closely  corresponds  to  the  current 
situation  in  your  organization  or  the  Air  Staff/OSAF  as 
applicable . 


A.  100% 

B.  80% 
20% 

C.  70% 
15% 
10% 

5% 

D.  50% 
40% 

5% 

5% 

E.  20% 
60% 

5% 

15% 

F.  10% 
60% 

5% 

25% 


batch  processing. 

batch  processing  and 
remote  job  entry  processing. 

batch  processing, 
data  base  processing, 
inquiry  processing,  and 
time- sharing  processing. 

batch  and  remote  job  entry  processing, 
data  base  and  data  communications  processing, 
personal  computing,  and 

minicomputer  and  microcomputer  processing. 

batch  and  remote  job  entry  processing, 
data  base  and  data  communications  processing, 
personal  computing,  and 

minicomputer  and  microcomputer  processing. 

batch  and  remote  job  entry  processing, 
data  base  and  data  communications  processing, 
personal  computing,  and 

minicomputer  and  microcomputer  processing. 


G.  Other,  please  explain: 


2)  Select  the  types  of  data  processing  applications/systems 
that  most  closely  represent  your  organization  at  the 
present  time. 

A.  There  is  a  concentration  on  labor  intensive  automation, 
scientific  support,  and  clerical  replacement. 

B.  Data  processing  applications/systems  are  beginning  to 
move  out  to  user  locations  for  data  generation  and 
data  use. 

C.  Balance  is  established  between  centralized  shared 
data/common  systems  applications  and  decentralized 
user-controlled  applications. 
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3)  Concerning  the  data/ information  processing  organization 
in  your  unit,  which  response  is  most  accurate. 

A.  Data  processing  is  centralized  and  operates  as  a 
closed  shop. 

B.  The  data  processing  organization  is  the  data  custodian. 
Computer  utility  is  established  and  reliable. 

C.  There  is  an  organizational  implementation  of  the  data/ 
information  resource  management  concept. 


4)  Your  organization's  data  processing  planning  and  control 
is  best  represented  by: 

A.  Internal  planning  and  control  is  installed  to  manage 
the  computer.  Included  are  standards  for  programming, 
responsibility  accounting,  and  project  management. 

B.  External  planning  and  control  is  installed  to  manage 
data  resources.  Included  are  value-added  user 
chargeback,  a  steering  committee,  and  data 
administration. 


5)  The  user  awareness  of  data  processing  systems  in  your 

organization  is  most  accurately  described  by: 

A.  Reactive:  The  end  user  is  superficially  involved. 

The  computer  provides  more,  better,  and  faster 
information  than  manual  techniques. 

B.  Driving  Force:  The  end  user  is  directly  involved  with 
data  entry  and  data  use.  The  end  user  is  accountable 
for  data  quality  and  for  value-added  end  use. 

C.  Participatory:  The  end  user  and  data  processing  are 
jointly  accountable  for  data  quality  and  for  effective 
design  of  value-added  applications. 


6)  Please  provide  any  additional  comments  you  have  on  the 
above  questions  and  responses. 


APPENDIX  B 

AIR  STAFF  DATA  PROCESSING  BUDGET 
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COMPONENTS  OF  THE 


DEPARTMENT  OF  THE 


VOLUME  II 


Computer  Systems  Program  (Part  1) 
(Dollars  in  Thousands) 
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The  total  Air  Staff  budget  data  includes  all  of  the 


data  in  Appendix  B.  The  remaining  data  comes  from: 

1.  Appropriations  3400  (0$M)  and  3080  (Base  Procure¬ 
ment)  for  FY  77  through  FY  81  actual  was  based  on  the 
30  September  certified  obligation  position. 

2.  The  FY  82  and  FY  83  0$M  budget  estimate  was 
developed  using  the  FY  83  Financial  Plan  submitted 
by  the  Air  Staff  on  19  May  1982. 

3.  Appropriation  3500  Military  Personnel  cost  was 
developed  on  the  basis  of  approved  authorization 
for  the  Management  Headquarters.  Approved  military 
personnel  standard  rates  were  used. 
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INTERVIEW/QUESTIONNAIRE  RESULTS 


Interview/Questionnaire  Results 


Question  Number 

Respondent 

1 

3 

4 

5 

Caswell 

Petroski 

Tufts 

ACM 

D  to  E 

D 

D 

A 

B 

B 

B 

ACM 

A 

B 

B 

B 

DA 

C 

C 

B 

C 

DA 

c 

C 

B 

C 

HC 

A 

A 

A 

B 

HC 

A 

A 

A 

B 

IG 

IN 

B 

NO  DATA  PROCESSING 

A  A 

C 

IN 

A 

B 

A 

A 

JA 

A 

B 

B 

C 

LE 

C 

C 

B 

C 

LE 

A 

- 

- 

B 

MP 

C 

C 

A 

B 

MP 

B 

B 

A 

C 

NB 

A 

- 

- 

A 

PR 

B 

C 

A 

B 

PR 

B 

A 

A 

C 

RD 

A 

B 

A 

A 

RE 

C 

B 

A 

B 

SA 

A 

C 

A 

B 

SA 

A 

C 

A 

B 

XO 

B 

B 

A 

B 

XO 

B 

B 

A 

B 

NGB 

B 

B 

A 

A 

1947th 

B 

C 

A 

C 

AFDSC 

B 

B 

A 

A 

AFDSC 

B 

B 

A 

C 

OSAF 

B 

- 

- 

C 
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